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DETAILED ACTION 

Continued Examination Under 37 CFR 1.114 

1 . A request for continued examination under 37 CFR 1.114, including the fee set 
forth in 37 CFR 1.17(e), was filed in this application after final rejection. Since this 
application is eligible for continued examination under 37 CFR 1.114, and the fee set 
forth in 37 CFR 1 .17(e) has been timely paid, the finality of the previous Office action 
has been withdrawn pursuant to 37 CFR 1.114. Applicant's submission filed on 26 
January 2010 has been entered. Claims 1-21 and 23-33 are pending. 

Response to Arguments 

2. Applicant's arguments filed with respect to claims 1 -21 , 23-25 and 27-33 have 
been fully considered but they are not persuasive. 

In the response the Applicant argues that the references fail to teach the newly 
recited futures of the claims, however, as explained below, the Applicant's specification 
fails to support the limitation as claimed, and thus the Examiner is interpreting the 
limitation to mean that all the controls that are visible in the interface area are 
accessible at all times, which as explained below is taught by the prior art. 

Further, on page 12 and 13, the Applicant first argues dependent claim 7 stating 
that each letter in Figure 3 of Durrani does not have a "menu associated with controls", 
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however, the claim does not require each letter to have a menu associated with 
controls, but rather the claim only requires "a menu of one of the controls" where one of 
the controls is one of the letters which is also the menu of the control, which has radius, 
where the radius of the arc is clearly shown to be at least a radius of the menu showing 
one of the letters. The Applicant is reading their claims with respect to their specific 
invention, whereas the Examiner is giving them their broadest reasonable interpretation. 

The Applicant then argues claims 8 and 9 with a similar argument that Durrani 
does not disclose "a menu of the control", however, as explained above Durrani does 
disclose this and therefore the rejection of these claims is also maintained. 

Further, the Applicant also argues claim 16 stating that the references fail to 
teach the locations of the controls, and that In re Japiske is no applicable because the 
references fail to teach a location. The Examiner respectfully disagrees. The 
references clearly teach that the items are located on the menu, and as such all of the 
controls would be located on the menu, and then In re Japiske is applied to teach that 
the specific location of these controls doesn't matter since the Applicant does not 
disclose the specific locations as being essential to their invention or having any benefit. 
Thus the rejection is maintained. 

Further, the Applicant also argues claim 25 stating that Keely, Jr. does not 
disclose "a dwell input," however, as explained in the rejection, the Examiner asserts 
that Keely, Jr. does teach "a dwell input." The term is not defined in the claims and thus 
the input mad by Keely, Jr. is the claimed "dwell" input. If the Applicant wishes for this 
limitation to have a specific meaning then it should be added to the claims. 
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Drawings 



3. The drawings are objected to under 37 CFR 1 .83(a). The drawings must show 
every feature of the invention specified in the claims. Therefore, the limitations "a first 
graphical user interface located in a lower left display corner responsive to a first natural 
motion by a user associated with a first end of a range of the first natural motion; and 
second graphical user interface located in a lower right display corner responsive to a 
second natural motion by the user associated with a second end of the range of the 
second natural motion;" of claim 32 must be shown or the feature(s) canceled from the 
claim(s). No new matter should be entered. 

Corrected drawing sheets in compliance with 37 CFR 1.121(d) are required in 
reply to the Office action to avoid abandonment of the application. Any amended 
replacement drawing sheet should include all of the figures appearing on the immediate 
prior version of the sheet, even if only one figure is being amended. The figure or figure 
number of an amended drawing should not be labeled as "amended." If a drawing figure 
is to be canceled, the appropriate figure must be removed from the replacement sheet, 
and where necessary, the remaining figures must be renumbered and appropriate 
changes made to the brief description of the several views of the drawings for 
consistency. Additional replacement sheets may be necessary to show the renumbering 
of the remaining figures. Each drawing sheet submitted after the filing date of an 
application must be labeled in the top margin as either "Replacement Sheet" or "New 



Application/Control Number: 10/748,686 Page 5 

Art Unit: 2629 

Sheet" pursuant to 37 CFR 1.121(d). If the changes are not accepted by the examiner, 
the applicant will be notified and informed of any required corrective action in the next 
Office action. The objection to the drawings will not be held in abeyance. 



Claim Rejections - 35 USC §112 

4. The following is a quotation of the first paragraph of 35 U.S. C. 112: 

The specification shall contain a written description of the invention, and of the manner and process of 
making and using it, in such full, clear, concise, and exact terms as to enable any person skilled in the 
art to which it pertains, or with which it is most nearly connected, to make and use the same and shall 
set forth the best mode contemplated by the inventor of carrying out his invention. 

5. Claims 1-21 , 23-25 and 27-33 are rejected under 35 U.S.C. 112, first paragraph, 
as failing to comply with the written description requirement. The claim(s) contains 
subject matter which was not described in the specification in such a way as to 
reasonably convey to one skilled in the relevant art that the inventor(s), at the time the 
application was filed, had possession of the claimed invention. 

The claims have been amended to recite "all controls visible and accessible at all times" 
which is not found in the specification. In fact, the specification states in paragraph 
[0032] for example that the control 92 allows the user to hid, suppress or minimize the 
interface, meaning that all the controls would not be visible and accessible at all times. 

Therefore, since the Applicant's specification fails to teach of the newly claimed 
limitation, for examination purposes with the prior art, the Examiner will interpret the 
limitation to mean that al of the controls that are visible are accessible at all times. 
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Claim Rejections - 35 USC § 103 



6. The following is a quotation of 35 U.S.C. 1 03(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

7. The factual inquiries set forth in Graham v. John Deere Co., 383 U.S. 1 , 148 
USPQ 459 (1966), that are applied for establishing a background for determining 
obviousness under 35 U.S.C. 103(a) are summarized as follows: 

1 . Determining the scope and contents of the prior art. 

2. Ascertaining the differences between the prior art and the claims at issue. 

3. Resolving the level of ordinary skill in the pertinent art. 

4. Considering objective evidence present in the application indicating 
obviousness or nonobviousness. 

8. Claims 1-9, 11-14, 20-21 , 23-24, 28-29, 31 and 33 are rejected under 35 U.S.C. 
1 03(a) as being unpatentable over Durrani et al. (US 6,01 1 ,542) in view of Iwema et al. 
(US 7,058,902). 

Regarding claim 1, Durrani et al. disclose an interface, comprising: 
a graphical user interface area located in a lower left display corner for a right- 
handed user responsive to a natural motion by a user associated with an end of a range 
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of the natural motion (Figure 3 shows graphical user interface 310 in a lower left display 
corner.) and, comprising: 

an arc shaped persistent graphic starting near a first display edge and ending 
near a second display edge and defining the interface area where the arc is 
substantially perpendicular to a natural motion path of the natural motion (Figure 3 
shows that the interface area has arc shaped persistent graphic 310.); and 

controls initiating an action located in the interface area, all the controls visible 
and accessible at all times, and accessible via the natural motion (Figure 3 shows 
controls 320 that initiate an action and that all the controls that are visible are accessible 
at all times..). 

Durrani et al. fail to explicitly teach the graphical user interface located in a lower 
right display corner for a left-handed user. 

Iwema et al. disclose of an interface comprising a graphical user interface area 
located to the left for a right-handed user and located to the right for a left-handed user, 
and that the controls of the interface are visible and accessible at all times (Column 12, 
lines 1-6 explain that the handedness of a user is taken into account for the location of 
the menu, Which is to the right for left handed users and to the left for right handed 
users.). 

Therefore, it would have been obvious to "one of ordinary skill" in the art at the 
time the invention was made to use the teachings of Iwema et al. with the interface 
located in a corner of the display taught by Durrani et al. in order to place the menu in 
the left hand corner for the right handed user and in the right hand corner for the left 
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handed user such that the hand of the user does not obscure the context menu (See 
column 12, lines 11-14 of Iwema et al.). 

Regarding claim 2, Durrani et al. and Iwema et al. disclose an interface as 
recited in claim 1, wherein the natural motion is a curve associated with movement of a 
hand of the user when an elbow of the user is pivoted (Since the interface is in the 
corner of the display, it is inherently "associated" with the movement of a hand of the 
user when an elbow of the user is pivoted.). 

Regarding claim 3, Durrani et al. and Iwema et al. disclose an interface as 
recited in claim 2, wherein a location responsive to the natural motion of the user hand 
is defined by the natural motion passing through a substantial center area of a display 
area (Since the interface is in the corner of the display, it is inherently in a location 
responsive to the natural motion of the user hand is defined by the natural motion 
passing through a substantial center area of a display area.). 

Regarding claim 4, Durrani et al. and Iwema et al. disclose an interface as 
recited in claim 1 , wherein the natural motion is a curve associated with movement of a 
hand of the user when an elbow of the user is pivoted and one of a wrist of the user is 
rotated and fingers of the user are moved (Please refer to the rejection of claim 2, 
where if the user's entire arm past the elbow is moving then the wrist and fingers are 
moved as well.). 
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Regarding claim 5, please refer to the rejection of claim 1 . 

Regarding claim 6, Durrani et al. and Iwema et al. disclose an interface as 
recited in claim 1 . 

Durrani et al. also disclose wherein the graphic is a shape corresponding to an 
arc shaped curve and the controls are positioned in accordance with the curve (Figure 
3). 

Regarding claim 7, Durrani et al. and Iwema et al. disclose an interface as 
recited in claim 6. 

Durrani et al. also disclose wherein a radius of the arc shaped curve is at least a 
radius of a menu of one of the controls (Figure 3). 

Regarding claim 8, Durrani et al. and Iwema et al. disclose an interface as 
recited in claim 6. 

Durrani et al. also disclose wherein a control closest to a display area is 
positioned along the curve at least a radius of a menu of the control from a display edge 
(Figure 3). 

Regarding claim 9, Durrani et al. and Iwema et al. disclose an interface as 
recited in claim 1 . 
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Durrani et al. also disclose wherein a menu associated with one of the controls 
has a layout responsive to the curve (Figure 3). 

Regarding claim 11, Durrani et al. and Iwema et al. disclose an interface as 
recited in claim 1 . 

Durrani et al. also disclose wherein the interface is located in a lower left corner 
of a display area (Figure 3), and also disclose that the controls of the interface are 
arranged as one of a convex arc across the corner , a concave arc across the corner, a 
line across the corner, an array in the corner, a convex corner across the corner, a 
convex arc with a linear portion across the corner, a sectioned pie in the corner, a 
sectioned pie in the corner and extending across the display area, and a rotatable circle 
intersecting both sides of the corner (Figure 3). 

Regarding claim 12, please refer to the rejection of claim 1 , where Durrani et al. 
also disclose wherein the controls are "associated" with an end of a range of a natural 
motion by the user where the approach arc is substantially perpendicular to a natural 
motion path of the natural motion and with the graphics of the controls being located 
responsive to one-shot function or menu pop-up function with a pop-up menu radius 
(Figure 3 shows that the controls have a "one-shot" function.). 

Regarding claim 13, Durrani et al. and Iwema et al. disclose the interface as 
recited in claim 12. 
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Durrani et al. also disclose wherein the zone shape comprises one of a wedge, a 
curved sides triangle and a curved sided trapezoid (Figure 3). 

Regarding claim 14, Durrani et al. and Iwema et al. disclose the interface as 
recited in claim 1 . 

Durrani et al. also disclose wherein the zones have non-coincident, dominant arc 
approach paths (Figure 3). 

Regarding claims 20 and 27, please refer to the rejection of claims 1 and 12 
and furthermore if the interface is located with controls as illustrated in the rejection of 
claims 1 and 12, then the controls would have been mapped as such and there would 
be a computer readable storage for controlling the mapping. 

Regarding claim 21, this claim is rejected under the same rationale as claim 5. 

Regarding claim 23, Durrani et al. and Iwema et al. disclose a method as 
recited in claim 20. 

Durrani et al. also disclose wherein the mapping maps controls on the arc 
responsive to a function of the controls (Figure 3). 

Regarding claim 24, Durrani et al. and Iwema et al. disclose a method as 
recited in claim 20. 
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Iwema et al. also disclose the method further comprising minimizing the interface 
responsive to activation of a minimize control (The menu is a pop-up menu, and thus 
when the user selection is over the menu/interace is minimized.). 

Regarding claim 28, please refer to the rejection of claims 1 , 5 and 1 2, where 
Durrani et al. shows a display in Figure 3, as also shown in Figure 1 of Iwema et al., and 
where there is a processor in the computer which will operate the display and will 
position the interface of the display (Figure 1 of Iwema et al.). 

Regarding claim 29, please refer to the rejection of claim 23 where the 
positioning is inherently performed by the processor. 

Regarding claim 31, please refer to the rejection of claim 1 , and furthermore 
Figure 3 of Durrani et al. covers the limitation of "an arc shaped display edge 
intersecting menu bar interface graphic". 

Regarding claim 33, this claim is rejected under the same rationale as claim 1 . 

9. Claims 25 and 30 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over Durrani et al. (US 6,01 1 ,542) in view of Iwema et al. (US 7,058,902) and further in 
view of Keely, Jr. et al. (US 6,337,698). 
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Regarding claim 25, Durrani et al. and Iwema et al. disclose a method as 
recited in claim 20. 

Durrani et al. and Iwema et al. fail to teach of displaying a menu upon a touch 
input and allowing a user to select an item of the menu, displaying a menu and 
performing an interaction upon a dwell input, and performing a function upon a stroke 
input 

Keely, Jr. et al. also disclose: 

displaying a menu upon a touch input (see col. 6, lines 54-55) and allowing a 
user to select an item of the menu (Fig. 1 0, shows the path a user takes to select an 
item); 

displaying a menu and performing an interaction upon a dwell input (col. 7, lines 
50-57, where the pen leaving the surface can minimize the menu therefore allowing the 
pen to dwell on the surface allows the user to interactively maintain the display of the 
menu); and 

performing a function upon a stroke input (col. 7, lines 27-30, where the user 
makes a selection via a stroke input). 

Therefore, it would have been obvious to "one of ordinary skill" in the art at the 
time the invention was made to use the inputting method taught by Keely, Jr. et al. with 
the interface method taught by the combination of Durrani et al. and Iwema et al. in 
order to allow for easy and intuitive user input into the computer system. 
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Regarding claim 30, please refer to the rejection of claim 25, where Keely, Jr. et 
al. also disclose an apparatus further comprising a stylus-based input system coupled to 
the processor and the display (col. 3, lines 49-50), and activating the controls 
responsive to a tap of a stylus on one of the controls (see col. 6, lines 54-55). 

10. Claim 10 is rejected under 35 U.S.C. 103(a) as being unpatentable over Durrani 
et al. (US 6,01 1 ,542) in view of Iwema et al. (US 7,058,902) and further in view of 
Kurtenbach (US 5,689,667). 

Regarding claim 10, Durrani et al. and Iwema et al. disclose an interface as 
recited in claim 1 . 

Durrani et al. and Iwema et al. fail to explicitly teach a marking menu associated 
with one of the controls having a layout where a downward stroke brings up additional 
tool palettes and/or dialogs. 

Kurtenbach discloses a marking menu associated with one of the controls has a 
layout where a downward stroke brings up additional tool palettes and/or dialogs (see 
col. 3, lines 35-60, where a user can bring up a new sub-menu, which constitutes a 
dialog, by making a stroke towards a menu item but not lifting up the pen). 

Therefore, it would have been obvious to one of ordinary skill in the art at the 
time of the invention to incorporate the teachings of Kurtenbach in the device taught by 
the combination of Durrani et al. and Iwema et al. to have a commonly known method of 
bringing up an a pop-up menu with a single stroke for allowing additional controls of the 
menu to be utilized. 
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1 1 . Claims 1 5-1 8 are rejected under 35 U.S.C. 1 03(a) as being unpatentable over 
Durrani et al. (US 6,01 1 ,542) in view of Iwema et al. (US 7,058,902) and further in view 
of Anderson et al. (US 5,828,360). 

Regarding claim 15, please refer to the rejection of claim 1 , and furthermore 
Durrani et al. and Iwema et al. fail to teach the controls comprising a tool control 
providing a menu for selecting a drawing tool of the application, and a color control 
providing a menu for selecting paint color applied by a drawing tool of the application. 

Anderson et al. disclose different categories of menu items in an arc-shaped 
menu (Fig. 3) and a menu including a tool control providing a menu for selecting a 
drawing tool of the application and a color control providing a menu for selecting paint 
color applied by a drawing tool of the application (Fig. 3, item 31c, see col. 5 lines 13- 
28, where the menu item 31c provides the sub-menu shown in the figure with the 
different drawing tools and for selecting the color.). 

Therefore, it would have been obvious to one of ordinary skill in the art at the 
time of the invention to incorporate the teachings of Anderson et al. in the menu of 
Durrani et al. and Iwema et al. in order to have different types of menu items in an arc- 
shaped menu in order to add the extra functions provided by the menu items and so 
that these menu items would be easily accessible to hand movements that a user can 
make and remember easily (see Anderson col. 2, lines 1-3). 
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Regarding claim 16, Durrani et al., Iwema et al. and Anderson et al. disclose an 
interface as recited in claim 15. 

Anderson also discloses an interface with a minimize control, an edit control 
providing an undo function (Figure 3 shows an undo control included in the menu), and 
Iwema et al. also disclose a page control providing a page change function for 
drawing pages of the application (Figures 5 and 6) and a tool type control and 
providing a menu for selection a tool type of the application (Figure 6). 

However, Durrani et al., Iwema et al. and Anderson et al. fail to teach the relative 
locations of each control as discussed in the claim. However, at the time of the 
invention it would have been obvious to a person of ordinary skill in the art to relocate 
the menu items as described in the claim since such a modification would have only 
involved a mere change in the location of the menu items. Applicants have not 
disclosed that the particular positioning of the menu items solves any stated problem, 
provides any advantage, or used for any particular purpose. Further, a change in 
location is generally recognized as being with the level of ordinary skill in the art, see In 
re Japiske, 86 USPQ 70 (CCPA 1950). Therefore, it would have been obvious to one of 
ordinary skill in the art at the time of the invention to modify the invention of Pitroda, 
Miyashita et al., Selker and Anderson et al. to obtain the invention as specified in the 
above claim. 

Regarding claim 17, Durrani et al., Iwema et al. and Anderson et al. disclose an 
interface as recited in claim 16. 
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Durrani et al. also disclose wherein the graphic comprises a arc-shaped band 
(Figure 3). 

Regarding claim 18, Durrani et al., Iwema et al. and Anderson et al. disclose an 
interface as recited in claim 16. 

Anderson et al. also disclose wherein pop-up menus pop-up in association with 
the selected control and at a distance from side and bottom edges of the graphic to 
allow all menu commands to be displayed (Figure 3 shows that the menu 32 pops up 
when 31c is selected which allows all controls to be seen.). 

12. Claim 19 is rejected under 35 U.S.C. 103(a) as being unpatentable over Durrani 
et al. (US 6,01 1 ,542) in view of Iwema et al. (US 7,058,902) and further in view of 
Anderson et al. (US 5,828,360) and Kurtenbach (US 5,689,667). 

Regarding claim 19, please refer to the rejection of claims 15 and 16 and 
furthermore Anderson et al. also disclose different categories of menu items in an arc- 
shaped menu (Fig. 3) and a menu including a tool control that provides a menu for 
selecting a drawing tool (Fig. 3, item 31c, see col. 5 lines 13-28, where the menu item 
31c provides the sub-menu shown in the figure with the different drawing tools), a 
minimize control (Fig. 3, where the 'miniview' control is a type of minimize control), and 
an undo control (Fig. 3 shows an undo control included in the menu). 
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Durrani et al., Iwema et al. and Anderson et al. fail to teach a marking menu 
associated with one of the controls has a layout where a downward stroke brings up 
additional tool palettes and/or dialogs. 

Kurtenbach discloses a marking menu associated with one of the controls has a 
layout where a downward stroke brings up additional tool palettes and/or dialogs (see 
col. 3, lines 35-60, where a user can bring up a new sub-menu, which constitutes a 
dialog, by making a stroke towards a menu item but not lifting up the pen). 

Therefore, it would have been obvious to one of ordinary skill in the art at the 
time of the invention to incorporate the teachings of Anderson et al. and Kurtenback in 
the menu of Durrani et al., Iwema et al. and Anderson et al. in order to have different 
types of menu items in an arc-shaped menu so that these menu items would be easily 
accessible to hand movements that a user can make and remember easily (see 
Anderson col. 2, lines 1-3) and to have a commonly known method of bringing up a 
pop-up menu with a single stroke. 

However, Durrani et al., Iwema et al. and Anderson et al. nor Kurtenbach teach 
the location of the tools relative to each other. However, at the time of the invention it 
would have been obvious to a person of ordinary skill in the art to relocate the menu 
items as described in the claim since such a modification would have only involved a 
mere change in the location of the menu items. Applicants have not disclosed that the 
particular positioning of the menu items solves any stated problem, provides any 
advantage, or used for any particular purpose. Further, a change in location is generally 
recognized as being with the level of ordinary skill in the art, see In re Japiske, 86 
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USPQ 70 (CCPA 1950). Therefore, it would have been obvious to one of ordinary skill 
in the art at the time of the invention to modify the invention of Pitroda, Miyashita et al., 
Selker, Anderson et al. and Kurtenbach to obtain the invention as specified in the above 
claim. 

13. Claim 32 is rejected under 35 U.S.C. 103(a) as being unpatentable over Durrani 
et al. (US 6,01 1 ,542) in view of Iwema et al. (US 7,058,902) and further in view of 
Sowden et al. (US 2003/0020687) 

Regarding claim 32, please refer to the rejection of claim 1 , and furthermore 
Durrani et al. and Iwema et al. fail to teach of having two graphical user interfaces, one 
in the lower right corner and one on the lower left corner, at the same time. 

Sowden et al. disclose of an locating a user interface for a left hand of a user and 
an interface for a right hand of a user (Figure 1 , 1 03 and also Figures 1 4 and 1 5). 

Therefore, it would have been obvious to "one of ordinary skill" in the art at the 
time the invention was made to use the teachings of having a different interface for each 
of the right and left hands as taught by Sowden et al. in the interface teachings taught 
by the combination of Durrani et al. and Iwema et al. such that there would be an 
graphical user interface like the one shown in Figure 3 of Durrani et al. in both the lower 
left and lower right corners in order to allow for the user to more quickly input 
information as opposed to the normal one handed input operation. 
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Allowable Subject Matter 

14. Claim 26 is allowed. 

1 5. The following is a statement of reasons for allowance: 

Relative to independent claim 26, the major difference between the prior art of 
record (Selker, Pitroda, Keekly, Jr. et al., Ono, Anderson, Kurtenbach, Miyashita et al., 
Durrani et al., Iwema et al. and Sowden et al.) and the instant invention, is that said 
prior art does not teach a method wherein if a user is inking from a drawing canvas and 
the inking crosses into the menu, inking still occurs on the canvas. 

Conclusion 

16. Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to STEPHEN G. SHERMAN whose telephone number is 
(571 )272-2941 . The examiner can normally be reached on M-F, 7:30 a.m. - 4:00 p.m.. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Amr Awad can be reached on (571 ) 272-7764. The fax phone number for 
the organization where this application or proceeding is assigned is 571-273-8300. 
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Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a 
USPTO Customer Service Representative or access to the automated information 
system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 

/Stephen G Sherman/ 
Examiner, Art Unit 2629 
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